Unit Testing Tool Competitions - Lessons Learned

نویسندگان

  • Sebastian Bauersfeld
  • Tanja E. J. Vos
  • Kiran Lakhotia
چکیده

This paper reports about the two rounds of the Java Unit Testing Tool Competition that ran in the context of the Search Based Software Testing (SBST) workshop at ICST 2013 and the first Future Internet Testing (FITTEST) workshop at ICTSS 2013. It describes the main objectives of the benchmark, the Java classes that were selected in both competitions, the data that was collected, the tools that were used for data collection, the protocol that was carried out to execute the benchmark and how the final benchmark scores for each participating tool were calculated. Eventually, we discuss the challenges encountered during the events, what we learned and how we plan to improve our framework for future competitions.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Designing Robot Competitions that Promote AI Solutions: Lessons Learned Competing and Designing

Robotics competitions are an educational tool at the middle school, high school, and university levels. The layout, rules, and reward systems of these competitions galvanize students to a specific solution space. From our experiences competing-in and designing such competitions, open-loop, low feedback strategies tend to dominate the winner's circle. If we want competitions to emphasize solutio...

متن کامل

Testing Cloud Services using the TestCast tool

This work presents the testing requirements for cloud services including unit and integration testing by identifying services that could communicate with each other according to their APIs. We also present the Elvior TestCast T3 (TTCN-3) testing tool that provides an efficient and easy to use solution for automating functional tests. This allows incremental development where users can test spec...

متن کامل

Shell We Play A Game? CTF-as-a-service for Security Education

Although we are facing a shortage of cybersecurity professionals, the shortage can be reduced by using technology to empower all security educators to efficiently and effectively educate the professionals of tomorrow. One powerful tool in some educators’ toolboxes are Capture the Flag (CTF) competitions. Although participants in all the different types of CTF competitions learn and grow their s...

متن کامل

Successful Automation of GUI Driven Acceptance Testing

Acceptance Testing is a fundamental part of XP. It provides the customer-developer “handshake” required for a project to succeed. One logical place to do this testing is at the GUI level. However, to do so requires a GUI testing tool. This paper will discuss the lessons we learned developing and using such a tool over the course of several projects. We believe that these lessons are generally a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2013